Research Article
Zara Ersozlu, Susan Ledger, Mark Babic, Robert Parkes
CONT ED TECHNOLOGY, Volume 18, Issue 3, Article No: ep674
ABSTRACT
Artificial intelligence (AI) is increasingly being explored in educational assessment, but its use in high-stakes performance contexts requires careful design to support quality, consistency, and human accountability. This study designed and evaluated an AI-supported workflow to assist assessors in marking teaching performance assessment (TPA) portfolios. TPA assessors first described how they usually evaluate portfolios, and this process was used to develop a meta-level rubric logic, prompts, and workflow for the AI agent. The workflow was tested by comparing human-only marking with AI supported marking in relation to time, accuracy, cognitive load, feedback quality, usability, bias, and fairness. The findings showed that the AI-supported workflow reduced marking time and perceived workload while supporting more structured, evidence-based feedback. It also contributed to greater consistency and fairness in the moderation process. The AI agent is positioned as a “third eye” that supports human judgement. Human assessors remain responsible for making final decisions and may accept, adapt or override AI-generated suggestions.
Keywords: GenAI, human-in-the-loop, cognitive load, time efficiency, judgement support, moderation, teaching performance assessment
Research Article
Soonri Choi, Hongjoo Ju, Jeein Kim, Jihoon Song
CONT ED TECHNOLOGY, Volume 16, Issue 2, Article No: ep507
ABSTRACT
Computer-supported collaborative learning is an instructional technique to solve complex tasks. One of the key factors to enhance collaboration is increasing the level of interdependence among the collaborators. This study was conducted to examine if the heterogeneous knowledge held by each member promoted by heterogenous instructional sequencings enhances the level of interdependence during collaboration. A quasi-experiment was conducted with college seniors preparing for their careers in a Shinhan University located in Gyeonggi-do, South Korea. The experiment consisted of two phases: one was, where students gained prior knowledge using homogeneous or heterogeneous complex-task sequencing. The other was, where they collaborated with each other using a computer-supported tool. The results showed the statistically significant difference between the two groups in terms of extraneous collective cognitive load, intrinsic motivation, and learning transfer. The collaborative groups of members, which utilized heterogeneous instructional sequencings during the individual learning phase showed relatively lower extraneous collective cognitive load, and higher intrinsic motivation in three consecutive collaborative sessions except for the first. As well as groups of members had higher learning transfer results. Implications and limitations were further discussed on results.
Keywords: collaborative learning, computer-supported collaborative learning, conservation of resource theory, collective cognitive load theory, complex-task instructional sequencings, intrinsic motivation
Research Article
Hua Zheng, Eulho Jung, Tong Li, Meehyun Yoon
CONT ED TECHNOLOGY, Volume 14, Issue 2, Article No: ep347
ABSTRACT
This experimental study examined the effects of segmentation and self-explanation designs on cognitive load in instructional videos. Four types of instructional videos (segmentation, self-explanation, combined, and control) were created and tested by 121 undergraduate students randomly assigned to one of four research groups. The results of students’ self-ratings on the cognitive load survey showed that the segmenting design produced a significantly less germane cognitive load than the two non-segmenting designs (self-explanation and control). The self-explanation design did not produce a significantly more germane load than the control design. However, students’ dispositions toward segmentation and self-explanation designs were generally positive and supported the theoretical justifications reported in the literature. The findings are discussed, along with segmentation dilemmas, limitations, and future study implications.
Keywords: instructional video, multimedia learning design principle, segmentation, self-explanation, cognitive load
Research Article
Bradley E. Wiggins
CONT ED TECHNOLOGY, Volume 4, Issue 1, pp. 30-49
ABSTRACT
This article presents the results from a post-test only experiment conducted in 2011 with undergraduate and graduate students (N=67) from individualist and collectivist cultures. Demographic information was collected through questions appearing at the end of a post-test administered to subjects after completing the e-learning module. Each person was randomly assigned to one of three e-learning modules which all shared identical instructional content: time travel. However, the modules differed in design. Specifically, while the control module was designed according to the coherence principle, one experimental module was designed with non-essential background music and the other was designed with non-essential background images. The coherence principle of multimedia instruction stipulates that the addition of extraneous audio, images, or text impairs learning. Nevertheless, one normative standard of multimedia design does not apply to a group of culturally and linguistically diverse learners. Among the findings from this study, a flexible coherence principle is proposed and it suggests that the multimedia designer must consider one’s own cultural and linguistic composition as well as that of the intended audience. A concluding discussion suggests that cultural variation may be related to cognitive variation.
Keywords: E-learning, Linguistic relativism, Cognitive Load Theory, Coherence principle, Collectivist - Individualist, Multimedia design